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INTRODUCTION 


While we may have the intuitive idea of one programming 
language having greater power than another, or of some subset 
of a language being an adequate "core" for that language, we 
find when we try to formalize this notion that there is a serious 
theoretical difficulty. This lies in the fact that even quite 
rudimentary languages are nevertheless "universal" in the follow¬ 
ing sense. If the language allows us to program with simple 
arithmetic or list-processing functions then any effective con¬ 
trol structure can be simulated, traditionally by encoding a 
Turing machine computation in some way. in particular, a simple 
language with some basic arithmetic can express programs for any 
partial recursive function. Such an encoding is usually quite 
unnatural and impossibly inefficient. Thus, in order to carry 
on a practical study of the comparative power of different lan¬ 
guages we are led to banish explicit functions and deal instead 
with abstract, uninterpreted programs, or schemas . What follows 
is a brief report on some preliminary exploration in this area. 


LANGUAGES 

The simplest language we shall study is a flow-chart lan¬ 
guage with which we write program schemas such as shown in 
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Fig. 1. When we have provided an interpretation for the basic 
function symbols and predicate symbols involved, a program schema 
may be regarded as an executable program defining a partial func¬ 
tion. As a convenient convention we take the arguments of this 
function to be the initial values of locations L^, L 2 ,... (up to 
as many as are mentioned) and the value as being the final value 
of L 0 if this is defined. Other locations M 0 , M 1# . . .,N Q ,N^,... 
are used only as "working space". We may as well assume that 
none of these latter locations is used as an argument before 
being assigned to. 
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Fig. 1. A program schema. 
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Another language we shall use provides for the recursive 
definition of functions using conditional expressions. For 
example: 

f (x r x 2 ) = 9( x 2) then F(if P(x^) then x 2 else A) 

else if P(x 2 ) then true else f(x 2 ,F(x 1 )) 

gCXj^) = if P (f (x 1# F (x-^)) then false else g(A) 

defines two abstract functions by simultaneous recursion. 

Given an interpretation of the basic function and predicate 
symbols (which are the upper-case symbols in the definitions), 
such a system defines a partial function corresponding to each 
equation. The system is deemed to compute the function given by 
hhe first definition. Such a system is called a recursive 
schema. If there is only one equation it is a simple recursive 
schema, if several it is compound . 

INTERPRETATIONS AND EQUIVALENCE 

inte rpretation , I, for program schemas and recursive 
schemas provides: 

(i) a domain D 

(ii) for each basic predicate symbol P, a (total) predicate 
P J : D — true , false l 
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(iii) for each n—ary basic function symbol (n > 0) F, a 
(total) function 
Fj s D n —VD 

In general, we use P, P', ... as predicate symbols and 

other capital letters as function symbols. A constant is a 
0-ary function. 

The partial function defined by Schema S under interpreta¬ 
tion I is denoted by Sj. For two partial functions u # v, we 
write u a v if, for all x, either both of u(x), v(x) are unde¬ 
fined or both are defined and u(x) = v(x). Two schemas s, S' 

(not necessarily of the same type) are (strongly) equivalent , 

S = S' if, for all interpretations I, Sj ^ S'j. 

Let d, be two classes of schemas. We write ^ 

if (VS C J)(3S' C i’) [s 5 S'] and A < A' it Aid' but 
not A' A • Let ^ be the class of recursive schemas and P be 

the class of program schemas. 

Theorem 1 . CP < 

■E r .? Q f* To show & ^ involves only a routine construction which 
we outline below. (For further details see [l 1 .) For each flow¬ 
chart box b A in program schema U, consider the abstract partial 
function f ± , which for given values of all the locations is com¬ 
puted as follows. Start the schema at b. with the locations 

1 

having these values, and then the value of the function is the 
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final value of L^, if defined. It is easy to write a compound 
recursive schema which defines the f^ recursively. If b Q is 
the START box then the function corresponding to U is got from 
f Q by simply suppressing some of its arguments. 

Now to show that the containment is proper, consider the 
following recursive schema V. 

V. f(x) = if P(x) then x 

else H(f(L(x>), f(R(x)) ) 

We shall show that no program schema can be equivalent to 
V. 

A useful notion is that of a free interpretation. In a 

free interpretation the domain is the set of all strings composed 

from the basic function symbols. Then, for example, if H is a 

binary function symbol and Ei, E are strings, 

2 

Hi(Ei,E 2 ) = H E^ E 2 for any free interpretation I. 

The interpretation of the predicate symbols is unconstrained. 

It should be clear that for most purposes, it is sufficient to 
consider only free interpretations. For example, for any S, S', 

S = S' if and only if S x = s r ‘ for all free I. 

For the present proof (and the next one) we consider the 
family of free interpretations i I n j, n n> q 


where 
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P I ( E ) = true if length(E) = n 
n 

= false otherwise. 

What is the value of V T ( X ) where X is the empty string? 

*n 

For n = 1, the value is H L R, 

for n = 2, itisHHLLRLHLRRR 

etc. 

We show that to compute the value for I at least n + 1 loca¬ 
tions are required for working space. It helps to present the 
same situation in a geometric form. We are to play a game of 
placing movable tokens on a finite binary tree, T . For n = 3 
the tree is given in Fig. 2. The rules of the game are that 
any token may be put on a bottom node at any time. If the two 
nodes below a given node are covered then any token may be put 
at the given node. How many tokens are needed to be able to 
reach the top node? It is easy to see that n + 1 are suffici¬ 
ent in general for T , and the following argument establishes 
their necessity. 



Fig. 2. Binary tree for n = 3. 
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A tree will be said to be closed at a given stage of the 
game if there is at least one token on each path from top to 
bottom. Initially, the tree is devoid of tokens and so is not 
closed. Finally there is a token at the top node and so it is 
closed. We concentrate our attention on the time at which the 
tree first becomes closed. This can only happen as a result of 
placing a token at a bottom node, closing off the last path. 

Now this path is otherwise empty of tokens and so each of the n 
sub-trees sprouting immediately off this path must be independently 
closed. Since at least one token is needed to close any tree, 
there are at least n+1 tokens on the tree at this time. 

The relation between a computation of a program schema and 
moves in this game we assume to be selfevident. Suppose a pro¬ 
gram scheme U is equivalent to V and has just r locations. This 
is immediately absurd because there is no way for u to compute 
the required output for the interpretation l r . This completes 
the first proof. 

Program schemas are therefore unequal to the task of com¬ 
puting certain abstract functions for the simple reason that a 
fixed number of locations cannot compute all the necessary final 
values. This is not a very interesting reason so we show in a 
second proof of the same theorem that program schemas can fail 
for more subtle reasons which reflect the inadequacy of their 
trol structure. The "target" schema for this proof computes a 


con- 
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partial predicate and is got from V, more or less, by replacing 
H by the Boolean function and . 

Second Proof of Theorem 1 . Consider the recursive schema: 

W. f(x) = if P(x) then true 

else if f(L(x)) then f(R(x)) else false 

Since the value of this schema is either true or is undefined, 
no argument of the kind given above is useful. Suppose program 
schema U is equivalent to W and has t boxes and r locations, and 
we may suppose, without loss of generality, that the only predi¬ 
cate and function symbols occurring in u are P, L, R. A state 
of U under a given interpretation is specified by a box of U 
together with a value from the domain for each location. Two 
states, S 1# S 2/ are (just-for-now) equivalent if the sequences of 
boxes for the computations continuing from s.^, S 2 are the same. 
Consider the equivalence classes of states of U under the inter- 
pretation defined above. With a little thought one can see 
that the only property of the value of a location which can affect 
the equivalence class is the length of the string. Furthermore, 
any two strings of length greater than n are indistinguishable 
by P either immediately or in their future. Thus, U has at most 
t•(n+2) r equivalence classes under I n . if, during a computation 
of U, an equivalence class is repeated then the computation is 


t 
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doomed to loop. U T ( A ) is supposed to terminate (with value 

n 

true), hence must never repeat an equivalence class, and there- 
_ r 

fore runs for no more than t-(n+2) steps. If n has been chosen 
sufficiently large that 

2 n > t•(n+2) r 

then U cannot have time to test each one of 

•4 -n-* ^-n-V ^ n-v 

P(L L ... L), P(R L ... L), . . . . , P(R R ... R) 

but nevertheless halts with value true . If we slightly modify 
Ijq by letting P be false for some such expression which is not 
tested, then of course U will never notice and still give the 
value true , but the value of W is now undefined. Thus U ^ W 
and the proof is complete. (Of course this method of proof 
works equally well for schema V.) 

LINEARLY RECURSIVE SCHEMAS 

The task of effectively characterizing those recursive 
schemas which are "programmable” is impossible. Indeed, if 
(P -01 is the subset of those recursive schemas which are equi¬ 
valent to some program schema, we can neither effectively enu¬ 
merate (P nor - (? . This follows from the application of 
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straightforward techniques which are described in |lj or ^2 
and will not be proved here. The best that we can hope for then 
is to effectively characterize large subclasses of (P and 
<fL - (P*. At present we have a fairly extensive effective sub¬ 
class of which encompasses both V and W and which we 

are seeking to extend further. 

On the other hand, an approximation to (P* is provided by 
the "linear" schemas which are described shortly. A recursive 
schema may be regarded as giving a way of computing the value of 
a nonbasic function given the values of the same or other func¬ 
tions at other arguments. The determination of these latter 
values will in general require further recursive calls, and so 
on. For example, in the following schema: 

f(x,y) = if P(x) then f(x,S(y)) else 

if P(g(R(x))) then S(x) else H(g(R(x)),R(y)) 

g(x) = if P'(x) then H(g(S(x)), R(g(S(x)))) 

else if P(x) then f(x,x) else A 

the evaluation of f(x,y) might need the value of f(x,S(y)) or 
the value of g(R(x)), and the evaluation of g(x) might need the 
value of g(S(x)) or f(X,x). But, notice in this example, and 
this is the defining criterion for a linear schema, that in any 


evaluation at most one further value of a nonbasic function is 
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immediately required. 

Theorem 2 . if x is linear then X.CfP*. 

Rather than give a proof of this theorem, we shall give 
here an example of the translation into program sch ema form of 
a simple linear program. The proof of Theorem 2, however, is by 
reducing the general linear case to a schema isomorphic to this 
example. So the following translation or compilation may be 
regarded as the "canonical” examplel 

f ( x ) = if P(x) then R(x) else S(f(T(x)), x) 

The second argument of S is an important feature, adding to the 

difficulty of this example. Let v v,,...v be the values of 

u J- m 

the successive instances of f called for in some terminating 
evaluation. We observe that: 

v m = R i( T I (m> (*)) 

v r = s i( v r+ l' T I <r> <*>) for r = 0.m - 1, 

and further, that if only we had some form of counter able to 

count up to integers less than or equal to m, then we could 

easily evaluate f by computing in turn v , v , v 

m ' m-l' ’ * *' o* 

However, such a counter can be simulated when 


we realize that: 
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(r) 

Pj(T I (x)) = false 


= true 


for r = 0, ..., m - 1 

for r = m. 


An equivalent program schema to L* is givai in Fig. 3. 


DISCUSSION 

Of course the efficiency of the above translation leaves 
something to be desired, and we are paying for our restriction 
to only a finite number of locations by an increase in the com¬ 
putation time. The cause of the problem in this example is that 
we are required to compute, in order, the sequence: 

T^ m) (x), T (m ” 1) (x), ..., TT(x), T(x) 

which the schema L does by computing each term independently all 
the way up from x, and thus requires of the order of m 2 opera¬ 
tions. To investigate this situation of trading off between 
time and space in more detail we have considered the following 
simple combinatorial problem. 

Suppose we have always available the value X in a "read¬ 
only" location, Mq, and we have in addition a further k locations, 
Mi # For given fixed m, we want to write a shortest pos¬ 
sible sequence of instructions of the form: 


M. : = T(M.) 
- L 3 


0 < i < k, 0 < j < k 
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Fig. 3. Program schema equivalent to a linear schema. 


to compute successively the values 

(X), ... TT(X), T(X). 


The values may appear in any location, but must be produced in 
the given order. Let L(k,m) be the length of the shortest such 
sequence of instructions. For example, L(l,m) = ^(m+l). we 


have derived an explicit formula for L(k,m) 


L (k,m) 


1+1A 

m 


from which we can show 
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Thus, there exists the possibility of computing linear recursive 
schematic functions using a fixed number of locations with rea¬ 
sonable efficiency. However, it is likely that some more versatile 
control structure than that of program schemas is required to 
realize the possibility. 

We are currently investigating the relations between various 
augmented forms of program schema, such as program schemas with 
counters, push-down stores, or stacks. These augmentations may 
either be expressed by more complicated definitions of "schema" 
or else may be got from the ordinary program schema by fixing part 
of the interpretation. For example, to express the idea of 
counters we could fix the interpretation of the constant symbol 
ZERO, function symbols ADDl, SUBl, and predicate symbol POSITIVE? 
in the obvious way. We must take care in applying some of the 
well-known results of automata theory to this area. For example, 
program schemas with counters are not "universal" in this theory, 
becuase the first proof of Theorem 1 shows that no such schema 
can be equivalent to the recursive schema V. However, we can 
show that under an appropriate definition of push-down store pro¬ 
gram schemas, they are equivalent to the class of recursive 


schemas. 
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A CLASS OF PARALLEL SCHEMAS 

For a very simple extension of recursive schemas we allow a 
parallel form of conditional expression. 

IF p THEN q ELSE r 

has the value q if p is true, the value r if p is false and in 
addition if p is undefined but q and r are both defined and are 
equal then the value is q. As a special case of this connective 
we define: 


p /OR/ q to mean IF p THEN true ELSE q 

So if either p or q has the value true then (p/OR/q) is true , and 
if both p and q are undefined it is also undefined. Let d* be 
the class of schemas we get by extending with /OR/. 

Theorem 3 . ^ ^ 

The proof of this theorem which is too long and detailed to 
give here is by showing that no recursive schema can be equivalent 
to the following schema. 

±>- f(x) = if p(x) then true else (f (L (x) )/OR/f (R(x) )) 

The value of s z ( X ) for a free interpretation I is true if there 
is at least one string of L's and R's for which P is true and is 
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undefined otherwise. In the proof we characterize the behavior 
of recursive schemas under the free interpretation where P is 
always false. The only strings on the binary tree of (L,R)-strings 
that a recursive schema can "look at" are those strings within a 
bounded distance of a finite number of paths descending through 
the tree. Therefore, any recursive schema must fail to test cer¬ 
tain strings and so will give a different value from S for some 
interpretations. 


CONCLUSION 

We have a clear notion of effective schemes of computation 
involving uninterpreted functions, and should like to have a 
fairly natural augmentation of program schemas capable of repre¬ 
senting any such effective computation. A good candidate for this 
supreme position in the hierarchy of schemas would seem to be pro¬ 
gram schemas with two push-down stores. Provided the schema has 
the ability to put special control constants in its stores and to 
subsequently recognize them, the "universality" of this model 
appears assured. 

Throughout this paper we have made the simplifying assumption 
that only total functions and predicates can appear in interpreta¬ 
tions. Removing this assumption changes several of our results 
and introduces new considerations. For example, to show that 
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0t<J we have only to notice that the schema 
f(x) = (P(x) /OR/ P*(x)) 

has no recursive equivalent. Also the concept of effective com¬ 
putation is now no longer unambiguous and depends on the conven¬ 
tions we adopt concerning the evaluation of partial basic 
functions. 
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